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Amendments to the Claims 
This listing of claims will replace all prior versions of claims in the application: 
Listing of Claims: 

1-53. (Cancelled) 

54. (Currently Amended) A system that monitors reaction to a media scene, 
comprising: 

a scene retriever that retrieves a scene from a media store and retrieves from the media 
store annotating metadata associated with the scene ; 

a metadata analyzer that analyzes the annotating metadata of the retrieved scene together 
with annotating metadata of at least one other scene in the media store in order to identify a 
relationship; 

a playlist generator that evaluates the relationship and produces a playlist of related 
scenes retrieved from the media store based on the relationship; 

a viewer that displays the scene playlist of related scenes ; a**d 

a feedback receiver that monitors passive feedback in response to the scene playlist 
displayed by the viewer, the passive feedback [[is]] comprises at least one of mood [[,]] a user's 
emotional reaction[[,]] or facial expressions as inferred by monitoring the user's facial expression 
using an image capture device and recognizing the user's emotional reaction via the monitored 
facial expressions [[.]] ; and 

a playlist updater that updates the playlist based at least in part on the passive feedback. 

55. (Currently Amended) The system of claim 54, the viewer is an active or 
intelligent device that performs a manipulation of the at least one scene in the playlist prior to 
display. 



2 



10/055,538 



MS 1 8 89 1 7.0 1/MSFTP304US 



56. (Previously Presented) The system of claim 55, the manipulation is at least one of 
cropping the scene, rotating the scene, increasing the play speed, decreasing the play speed, color 
correction, digital data reconstruction, decompression, color conversions, or voice translation. 

57. (Currently Amended) The system of claim 54, the feedback receiver further 
receives active feedback associated with the scene playlist displayed by the viewer, the active 
feedback is at least one of a touch input, a typed input, a mouse input, or a voice input. 

58. (Currently Amended) The system of claim 57, the active feedback comprises at 
least one of[[,]] a command to skip ahead in the playlist, a command to skip back in the playlist, 
a command to generate a new playlist, a command to find scenes similar to the current scene, or 
a command to play a longer scene related to the current scene. 

59. (Cancelled) 

60. (Currently Amended) The system of claim [[59]] 54, the scene retriever retrieves 
the scene based at least in part on a value stored in the associated annotating metadata. 

61. (Currently Amended) The system of claim [[59]] 57, further comprising at least 
one of the following: wherein the playlist updater updates the playlist based additionally on the 
active feedback. 

a metadata analyzer that analyzes the annotating metadata in connection with at least one 
of the passive feedback or active feedback in order to identify a relationship; 

a playlist generator that evaluates the relationship and that further produces a playlist of 
related scenes; or 

a playlist updater that updates the playlist based at least in part on at least one of the 
passive feedback, the active feedback, additional passive feedback, or additional active feedback. 

62. (Currently Amended) The system of claim [[61]] 54, the playlist generator 
populates the playlist with related scenes based at least in part on a value stored in the annotating 
metadata for each respective scene. 
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63. (Currently Amended) The system of claim [[61]] 54, the playlist updater updates 
the playlist based on at least one of[[,]] a usage data, a feedback command, or a time stamp. 

64. (Currently Amended) The system of claim [[61]] 54, the metadata analyzer 
computes a similarity value for the relationship between respective scenes . 

65. (Previously Presented) The system of claim 64, the playlist generator produces the 
playlist of related scenes based at least in part on the similarity value. 

66. (Previously Presented) The system of claim 54, further comprising at least one of 
the following: 

a scene selector that scans a digitized media and selects a scene in the digitized media; 

a metadata generator that produces metadata associated with the selected scene and 
relates the metadata to the selected scene; or 

an organizer that places the selected scene and the metadata in a media store to facilitate 
non-linear viewing of one or more scenes. 

67. (Currently Amended) The system of claim 66, the scene selector selects a scene 
based on at least one of[[,]] face recognition, item recognition, voice recognition, color 
recognition, mood recognition, or theme recognition. 

68. (Previously Presented) The system of claim 66, the scene selector selects a scene 
based at least in part on the passive feedback or based on an input from a user. 

69. (Currently Amended) The system of claim [[68]] 67, the at least one of the face 
recognition, item recognition, voice recognition, color recognition, mood recognition and theme 
recognition is adapted by a machine learning technique based at least in part on the input from 
the user. 
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70. (Previously Presented) The system of claim 66, the metadata generator produces 
and stores to the metadata at least one of a date, a time, a length, a subject, a mood, a theme, a 
color, a person name, a set of person names, an item name, or a set of item names associated 
with the scene. 

71 . (Currently Amended) A method for obtaining reactions associated with viewing 
of media, comprising: 

accessing a scene stored in a media store; 

accessing metadata associated with the scene from the media store; 

analyzing the metadata associated with the scene in view of metadata associated with at 
least one other scene in the media store; 

identifying at least one relationship between a subset of scenes in the media store based 
on the analysis; 

generating a playlist comprising the subset of scenes based on the identified relationship; 
presenting the scene playlist to a user; and 

recording passive feedback from the user as the scene playlist is presented, the passive 
feedback comprising at least one of an inferred mood of the user [[,]] an inferred emotional 
reaction by the user as recognized by reading the user's facial expressions using an image capture 
device[[,]] or facial expressions of the user ; and 

updating the playlist based at least on the passive feedback. 

72. (Cancelled) 

73. (Currently Amended) The method of claim [[72]] 71, further comprising 
receiving active feedback from the user as the scene is presented. 

74. (Previously Presented) The method of claim 73, the act of receiving active 
feedback further comprises receiving at least one of a touch input, a typed input, a mouse input, 
or a voice input. 
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75. (Currently Amended) The method of claim 73, further comprising at least one of 
the following acts: 

analyzing the metadata associated with the presented scene; 
analyzing at least one of the passive feedback or active feedback; 

evaluating a relationship between the metadata and either one of the passive feedback or 
the active feedback; or 

generating a play list of stored scenes based upon the relationship. 

76. (Previously Presented) The method of claim 75, the act of generating a playlist 
comprises at least one of selecting a scene based on the presence of a face in the scene, selecting 
a scene based on the absence of a face in the scene, selecting a scene based on the presence of an 
item in the scene, selecting a scene based on the absence of an item in the scene, selecting a 
scene based on a voice in the scene, selecting a scene based on the absence of a voice in the 
scene, selecting a scene based on a mood of the scene and selecting a scene based on the theme 
of the scene. 

77. (Previously Presented) The method of claim 76, the act of evaluating a 
relationship further comprises computing a similarity score for the relationship based upon the 
metadata that comprises information concerning at least one of a present face, a present item, a 
present voice, a present mood, or a present theme. 

78. (Previously Presented) The method of claim 76, the act of generating a playlist 
further comprises placing a scene identifier in the playlist. 

79. (Previously Presented) The method of claim 75, the act of generating a playlist 
further comprises creating a playlist of disparate scenes based at least one of the passive 
feedback or the active feedback. 

80. (Cancelled) 
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81 . (Currently Amended) The method of claim [[80]] 7J_, the act of updating the 
playlist comprises at least one of adding a scene to the playlist or removing a scene from the 
playlist. 

82. (Previously Presented) The method of claim 75, further comprising navigating the 
playlist based upon at least one of the passive feedback, the active feedback, additional passive 
feedback, or additional active feedback. 

83. (Previously Presented) The method of claim 82, the act of navigating the playlist 
comprises at least one of moving forward in the playlist, moving backward in the playlist, or 
displaying a media item related to the scene. 

84. (Previously Presented) The method of claim 75, further comprising navigating the 
scene based upon at least one of the passive feedback, the active feedback, additional passive 
feedback, or additional active feedback. 

85. (Previously Presented) The method of claim 84, the act of navigating the scene 
comprises at least one of moving forward in the scene, moving backward in the scene, changing 
the rate of scene traversal, pausing the scene, or displaying a media item included in the scene. 

86. (Withdrawn) A method for facilitating non-linear viewing of media, comprising: 
receiving passive feedback related to a viewed media scene, the passive feedback relates 

to an inference associated with at least one of a mood, an emotional reaction, or a facial 
expression during presentation of the viewed media scene; 

selecting related scenes by analyzing a metadata associated with the viewed scene if the 
passive feedback is determined or inferred to desire related scenes; 

generating a new playlist of media scenes if the passive feedback is determined or 
inferred to desire a new playlist; and 

navigating a playlist by selectively skipping forward or backward in the playlist if the 
passive feedback is determined or inferred to desire navigation. 



7 



10/055,538 



MS 1 8 89 1 7.0 1/MSFTP304US 



87. (Withdrawn) A system for annotating video media, comprising: 

a media database comprising a playlist and one or more video segments, where the video 
segments are associated with an annotating metadata; and 

an annotating tool that creates the annotating metadata and that associates the annotating 
metadata with the video segments based upon passive feedback, the passive feedback includes at 
least one of a mood, an emotional reaction, or a facial expression obtained while displaying one 
or more video segments. 

88. (Withdrawn) The system of claim 87, the annotating metadata comprises at least 
one of, a date identifier, a time identifier, a videographer identifier, a face identifier, an item 
identifier, a voice identifier, a mood identifier and a theme identifier. 

89. (Withdrawn) The system of claim 87, the annotating tool generates the annotating 
metadata in response to a user input. 

90. (Withdrawn) The system of claim 87, the annotating tool automatically generates 
the annotating metadata based at least in part on a face recognition, an item recognition data, a 
voice recognition data, mood data or theme data. 

91 . (Withdrawn) The system of claim 90, the annotating tool is adapted based on a 
machine learning technique based at least in part on a user input concerning the annotating 
metadata generated by the annotating tool. 

92. (Withdrawn) A method that facilitates non-linear viewing of media, comprising: 
selecting a scene from a set of digitized media; 

annotating the selected scene with metadata based upon passive feedback obtained during 
presentation of one or more scenes, the passive feedback is at least one of a mood, an emotional 
response, or a facial expression; and 

storing the annotated scene to facilitate non-linear retrieval of the annotated scene. 
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93. (Withdrawn) The method of claim 92, the act of selecting the scene from the set 
of digitized media further comprises: 

manually scanning one or more scenes from the set of digitized media; and 
manually selecting the scene. 

94. (Withdrawn) The method of claim 92, the act of selecting the scene from the set 
of digitized media comprises: 

automatically scanning one or more scenes from the set of digitized media; and 
automatically selecting the scene based on at least one of face recognition, item 
recognition, voice recognition, color recognition, mood recognition and theme recognition. 

95. (Withdrawn) The method of claim 92, the act of annotating the selected scene 
with metadata further comprises associating at least one of a date, a time, a length, a subject, a 
mood, a theme, a color, a person, a set of people, an item or a set of items with the selected 
scene. 

96. (Withdrawn) The method of claim 92, further comprising storing the annotated 
scene to at least one of a database or a datacube for facilitating non-linear retrieval of the 
annotated scene. 

97. (Withdrawn) A system for delivering media content, the system comprising: 
a media data store comprising one or more metadata annotated, displayable items; 

a presenter that presents a selected first displayable item from the media data store; 

a selector that selects a second displayable item from the media data store based, at least 
in part, on a relationship between a first metadata associated with the first displayed item and a 
second metadata associated with the second displayable item; and 

an evaluator that determines and evaluates the relationship based upon passive feedback 
acquired from display of one or more displayable items, the passive feedback comprises at least 
one of a mood during display, a facial expression during display, or an emotional response 
during display. 
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98. (Withdrawn) The system of claim 97, the media data store is at least one of a 
database, a data cube, a list, an array, a tree, or a file. 

99. (Withdrawn) The system of claim 97, the presenter is at least one of an intelligent 
display and a no n- intelligent display. 

100. (Withdrawn) The system of claim 97, the presenter is at least one of an active 
display and a passive display. 

101 . (Withdrawn) The system of claim 97, the selector selects a second displayable 
item based at least in part in response to a user response to the first displayable item. 

102. (Withdrawn) The system of claim 101, the user response is at least one of, a 
spoken word, a keystroke, a mouse click, or a facial expression. 
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